Skip to content

Exectuion and optimization tracing harness for testing#7814

Draft
AdamGS wants to merge 2 commits intodevelopfrom
adamg/execution-tests
Draft

Exectuion and optimization tracing harness for testing#7814
AdamGS wants to merge 2 commits intodevelopfrom
adamg/execution-tests

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented May 6, 2026

Summary

Closes: #000

Testing

@AdamGS AdamGS added the changelog/feature A new feature label May 6, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/execution-tests branch from 1520af8 to 51759b3 Compare May 6, 2026 14:41
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 6, 2026

Merging this PR will degrade performance by 21.73%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

❌ 9 regressed benchmarks
✅ 1197 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_opt_bool_into_canonical[(10, 1000)] 1.4 ms 1.6 ms -10.32%
Simulation chunked_varbinview_into_canonical[(10, 1000)] 2.1 ms 2.4 ms -10.8%
Simulation search_index_above_max 269.2 µs 308.5 µs -12.75%
Simulation search_index_below_min 265.2 µs 304.6 µs -12.92%
Simulation search_index_full_range_random 267.2 µs 306.5 µs -12.84%
Simulation search_index_in_range 267.6 µs 307 µs -12.83%
Simulation search_index_mixed_out_of_range 267.2 µs 306.7 µs -12.86%
Simulation varbinview_zip_block_mask 2.9 ms 3.7 ms -21.73%
Simulation varbinview_zip_fragmented_mask 6.4 ms 7.2 ms -10.43%

Comparing adamg/execution-tests (ee56f7b) with develop (eda8c2c)

Open in CodSpeed

Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant